Thermodynamic derivation and use of a nonequilibrium canonical ensemble 
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A thermodynamic expression for the analog of the canonical ensemble for nonequilibrium systems 
is described based on a purely information theoretical interpretation of entropy. As an application, 
it is shown that this nonequilibrium canonical distribution implies some important results from 
nonequilibrium thermodynamics, specifically, the fiuctuation theorem and the Jarzynski-equality. 
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In this letter we demonstrate that the information- 
theoretical definition of entropy implies some important 
results in non-equilibrium thermodynamics, such as the 
fluctuation theorem and the Jarzynski-equation. The 
central tenet is that for two states A and B of a sys- 
tem, defined by two sets of macroscopic parameters, the 
ratio of the probabilities pb /pa for the system to be in 
either state is 



Pb/pa = exp(AABS'/fcB), 



(1) 



with IS.abS difference in entropy between the states B 
and A. This is essentially the Boltzmann definition of 
entropy, combined with the observation that in the ab- 
sence of any other information, each state is assumed to 
have equal probability. The latter assumption is in an 
information-theoretical setting equivalent to the princi- 
ple of indifFerence: the absence of any distinguishing in- 
formation is equivalent to equal prior (prior to obtaining 
additional information) probabilities 1]. 

Following Boltzmann, we define the entropy S as the 
logarithm of the number of states accessible to a system 
under given macroscopic constraints. For an isolated sys- 
tem, the entropy is related to the size $ of the accessible 
phase space. 



S = kB In*. 



(2) 



For a classical system, the phase space size $ is the 
hyper-area of the energy shell, and it defines the usual 
microcanonical ensemble. The hyper-area $ is non- 
dimensionalised such that $(C/) dU is proportional to the 
number of states between energies U and U+dU. We will 
not consider other required factors which make the argu- 
ment of the logarithm non-dimensional; these contribute 
an additive entropy constant which will not be of interest 
to us here. Note also that the microcanonical ensemble 
does not include a notion of equilibrium: the system is 
assumed to be insulated so it cannot equilibrate with an 
external system. It just moves around on the energy shell 
and the assumed ergodicity implies that all states, how- 
ever improbable from a macoscopic point of view, are 
members of the ensemble. Of course, the number of un- 
usual states (say, with non-uniform macroscopic density) 
is much lower than the number of regular states (say, with 



uniform macroscopic density) for macroscopic systems. 
Only for small systems, the distinction becomes impor- 
tant but it does not invalidate the above formal definition 
of entropy. The above definition of entropy also ensures 
that entropy is an extensive property such that for two in- 
dependent systems considered together the total entropy 
is the sum of the individual entropies, = -I- 5*2 . The 
Boltzmann constant fc^ ensures dimensional compatibil- 
ity with the classical thermodynamic entropy when the 
usual equilibrium assumptions are made Q . 

The hyper-area of the energy shell, and thus the en- 
tropy, can be a function of several variables which are set 
as external constraints, such as the total energy U, sys- 
tem volume, V, or particle number N. For the canonical 
ensemble we consider a system that can exchange energy 
with some reservoir. We consider here only a theoreti- 
cal canonical ensemble in that we consider the coupling 
between the two systems to be weak. 

First, we need to define what a reservoir is. Follow- 
ing equilibrium thermodynamics, we formally define an 
'inverse temperature' /? = {kBT)~^ as 



(3 = kg^dS/dU = ^-^d^/dU. 



(3) 



We make no claim about the equality of /? and the classi- 
cal equilibrium inverse temperature; j3 is the expansivity 
of phase space with energy and as such can be defined for 
any system, whether it is in thermodynamic equilibrium 
or not. When an isolated system is prepared far from 
equilibrium (for example, when it has a local equilibrium 
temperature which varies over the system) then fi is still 
uniquely defined for the system as a non-local property 
of the energy shell that the system resides on. Because 
both energy and entropy in the weak coupling limit are 
extensive quantities, /3 must be an intensive quantity. 

Now consider a large isolated system R with total (in- 
ternal) energy Ur. Let this system receive energy U' 
from the environment. By expanding S in powers of J7, 
we can then write the entropy of this large system as 

Sr{Ur^U') = SR{UR)+kBU' (^p -f if/'l^ + 0{U'^\ 

(4) 

We see that for finite [/', {df3/dU) ^ has to be an ex- 
tensive quantity. But that means that for a very large 
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system dp/dU = 0{N~^), where iV" is a measure of the 
size of the system (such as particle number). For a clas- 
sical thermodynamic system df3/dU = —UbP'^/Cv with 
Cy the heat capacity at constant volume. We conclude 
that for a very large system {N oo), the entropy equals 



states r such that 



Sr{Ur + U') = Sr{Ur) + kePU' 



(5) 



for all relevant, finite energy exchanges U' . This expres- 
sion for the entropy defines a reservoir. The size of the 
energy shell accessible to the reservoir is, for all relevant 
energy exchanges C/', exactly proportional to exp(/3[/'), 
with /? an intensive and constant property of the reser- 
voir. We do not require the reservoir to be in thermody- 
namic equilibrium. A change of energy in the reservoir 
pushes the reservoir to a different energy shell; the func- 
tional dependence of the size of the energy shell with 
energy defines the 'inverse temperature' /3, as in Eq. [3l 
However, it is not assured that a small and fast ther- 
mometer would measure an inverse temperature equal to 
/? at some point in the reservoir; only if the reservoir is 
allowed to equilibrate, its inverse temperature is every- 
where equal to /?. Of course, this is precisely how the 
temperature of a reservoir is determined in practice. 

Now suppose a system of interest has energy C/q- We 
then allow it to exchange heat U with a reservoir. If 
the system has energy Uq + U , the reservoir must have 
given up energy U . We can write the hyper-area of the 
energy shell of the system $o as a function of U . The 
total entropy of the system plus reservoir R can then be 
written as 



S = So{U) + SR{UR)-kBpU, 



(6) 



with 5*0 = fcs In'l'o- The number of states at each level 
of exchange energy therefore is proportional to 



$([/) oc $o(C/) exp(-/3t/). 



(7) 



where we omitted proportionality constants related to 
the additive entropy constants. Nowhere we assume that 
the system is in equilibrium with the reservoir. This 
means that $(J7) is the relevant measure to construct 
an ensemble average for the system, even for far-from- 
equilibrium systems. Even the reservoir can be out of 
equilibrium, as discussed above. We have also made no 
reference to the size of the system of interest, as long 
as it is much smaller than the reservoir. However, in 
contrast to systems in thermodynamic equilibrium, there 
is no guarantee that the extensive variables, such as C/, F, 
or define the state of the system in any reproducible 
sense. To fully define an out-of-equilibrium system we 
need to introduce order parameters that can describe the 
non-equilibrium aspects of the system. 

The above density is an integrated version of the usual 
canonical distribution. The size of the energy shell of the 
system of interest, $0: can be written as an integral over 



*o(t/) 



dr, 



Ho{T) = U 



(8) 



with iJo the Hamiltonian of the system of interest . With 
this definition, the density in Eq. [7] reduces to the usual 
canonical distribution exp(— /3iJo(r)) for states F. We 
will not make further use of this microscopic version of 
the density. 

The canonical density in Eq. [7] can be expanded by 
parametrizing each energy shell with some continuous 
coordinate w, so that every part of phase space has co- 
ordinates {U,v). At each value of v the differential 
4>(U, v) dU dv is proportional to the number of states be- 
tween coordinate values U and U + dU, and v and v + dv, 
and it is normalised such that 



(t){U,v)dv = ^oiU). 



(9) 



The parametrisation is arbitrary at this point and can be 
chosen such as to divide the phase space in as fine a struc- 
ture as desired for a given application. We can define an 
entropy So(U, v) again as the logarithm of the number of 
available states for the system of interest corresponding 
to point ([/,«), 



(10) 



Now consider a process that occurs on the energy shell 
U where some variable changes from A ^ B . On the 
parametrized energy shell this corresponds to a coordi- 
nate shift from v{A) — > v{B). The number of corre- 
sponding states changes from <p{U,v{A)) — ^ (p{U,v{B)). 
We can use detailed balance to express the ratio of the 
probability of making this transition to the probability of 
making the reverse transition as the ratio of the number 
of states at (C/, v{A)) to the number of states at [U, v{B)): 



PA^B ^ (b{U,v(B)) 
PB^A (j){U,v{A)) 



= GXp(AA_B5/fcB) 



(11) 



where AAij^/fcs = Sn{U,v{B))- So{U,v{A)). The Liou- 
ville theorem implies that the local phase space volume 
is conserved when a system moves on the energy shell, 
so that /S.abS has to vanish for every realisable trans- 
formation. However, this is not the case anymore if the 
system moves between energy shells. If, in addition, dur- 
ing the process A ^ B the energy of the system of inter- 
est changes from Ua — ^ Ub through exchange with the 
reservoir, then the above ratio of probabilities can still 
be expressed as exp(A^BS'/fcB) but now with 



^abS = So{Ub,v{B)) - So{Ua,v{A)) - kB^E 



Ua). 
(12) 

We can always write the entropy change of the system 
of interest as the sum of the entropy change due to heat 
exchange with the reservoir and an irreversible entropy 
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change associated with uncompensated heat viz. 
SoiUB,v{B)) - SoiUA,v{A)) = kBl3{UB ~ Ua) + XSq. 
We thus conclude that A^bS ~ A^S'q, that is, the rele- 
vant entropy change in Eq. [TT] equals the irreversible en- 
tropy change of the system of interest. So for processes 
that occur either on or across energy shells, we have 



Pb^a 



exp(AiS'o/fcs) 



(13) 



with AiSo the irreversible entropy change of the system 
in a process A B. The right-hand-side of this equation 
is only dependent on the irreversible entropy change AiSo 
between the two states of the system of interest. So this 
equation must be true for any pair of states (A, B) that 
are related by the same irreversible entropy change. We 
thus arrive at the Huctuation theorem M, 



piA.,S) 
pi-A,S) 



exp(Ai5/fc_B), 



(14) 



with p(AiS) the probability the system of interest makes 
a transition with irreversible entropy change of AiS and 
p{—AiS) the probability for the opposite change. 

The fluctuation theorem applies to spontaneous pro- 
cesses that occur in thermostatted but otherwise isolated 
systems. We next consider processes that occur when we 
modify the system of interest by changing some exter- 
nal macroscopic parameters. The entropy of the energy 
shell U is then also a function of some parameter A, viz., 
S = S\{U, v). Without loss of generality we set A = at 
A and A = 1 at i?. In this case the irreversible entropy 
change in, Eq. [131 is 

A,S/kB = Sl{UB,viB))~SoiUA,v{A))^kB|3{UB-UA)■ 
{l5) 

Apart from this, there is no change in the considerations 
leading to the fluctuation theorem. By definition, ther- 
mostatted systems that receive work Wab from their en- 
vironment have an irreversible entropy change equal to 



XS/kB = I3{Wab - AabF), 



(16) 



with AabF the change in free energy going from A to 
B. Recognising that the right-hand-side is again only 
a function of the difference between the two states, we 
arrive at the Crooks fluctuation theorem 0|, 



Pf)i{W) 
Pio{-W) 



exp(/3(iy- AoiF)), 



(17) 



with poi{W) the probability that the system absorbs 
work W when A changes from to 1, and pioi—W) the 
probability that the system performs work W when A 
changes in reverse from 1 to 0. Because the transition 
probabilities can be normalised with respect to the ex- 
changed work, it is straightforward to use this equation to 
show that the expectation value of exp{—/3{W — AqiF)) 
equals unity, or equivalently. 



(exp(-/?Ty)) =exp(-/?AoiF). 



(18) 



This is the Jarzynski equation fi']. 

The consistency of the above argument is strengthened 
by the following independent route to calculate free en- 
ergy changes. The phase space measure $(J7) can be 
normalised with the partition function Zx, 



Zx = J $a(C/) exp(- 



-I3U) dU. 



(19) 



where ^\{U) is proportional to the number of accessible 
states of the isolated the system of interest when the ex- 
ternal parameter is set to A. The equilibrium free energy 
for the thermostated system is 



-13-HnZx 



(20) 



Next we consider what happens to the equilibrium free 
energy of the system when we vary A from to 1. The 
partition function at A = 1 satisfies 



Zi 



$i(C/) exp{~(3U)dU 



(21) 



= j <^o{U) exp{AS/kB) exp{~l3U)dU (22) 

= Zo {exp{AS/kB)) (23) 

where (.) denotes an ensemble average over the initial 
ensemble, and A5 = fcs ln($i(t/)/$o(C^)- As before, the 
entropy change can be written as the sum of the entropy 
change due to heat exchange with the reservoir and the 
irreversible entropy change due to uncompensated heat. 
Because the system plus the reservoir are thermally in- 
sulated, any heat given to the reservoir must be com- 
pensated by work performed by the external parameter 
change. The entropy change, above can therefore be writ- 
ten as (exp(AS'/fcB)) = (exp(Ai5/fcs - PW)) so that we 
find 



Zi/Zo^{exp{A,S/kB~l3W)). 



(24) 



Because Eq. is true for any microscopic realisation of 
the process, we find that the right-hand-side of the above 
equation is the same for every realisation and it is equal 
to exp{—f3AF). This is consistent with the equilibrium 
expression for the free energy, Eq. 1201 from which foil- 
lows that exp(— /3AF) = Zi/Zq- The above equation is 
only apparently in contradiction to the Jarzynski equa- 
tion, Eq. 1181 To arrive at the Jarzynski equation we 
recognise that Eq. [TBI implies that {exp{(3{AF — VF))) = 
(exp(— AiS'/fcs)) — 1, where the last equality follows 
from integrating the fluctuation theorem over all values 
of A,S. 
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